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^The  purpose  of  this  research  was  to  evaluate  the  validity  of  peer  ratings 
obtained  durinq  the  Ranger  course  in  predicting  subsequent  performance  in  ac- 
tual duty  assignments.  A criterion  instrument,  was  used  to  obtain  ratings  of 
ovorall  duty  performance  and  of  potential  performance  in  combat  leadership, 
technical-manaqorlal  leadership,  tactical  knowledge,  defining  personal  roles, 
decisionmaking,  defining  functional  roles,  motivating  troops,  and  tactical 
knowledge.  The  relationships  among  the  peer  ratings,  measures  of  Ranger 
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20.  (continued) 

^course  performance  and  the  criterion  measures  of  performance  and  potential 
performance  were  assessed  by  correlation  techniques.  Results  indicate  that 

the  relationship  between  peer  ratings  and  ratings  of  performance  and  poten- 
tial performance  was  higher  than  for  other  measures  of  student  performance 
in  the  Ranger  course.  „ 
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ARI  Research  Reports  and  Technical  Papers  are  intended  for  sponsors  of 
R&D  tasks  and  other  research  and  military  agencies.  Any  findings  ready  for 
implementation  at  the  time  of  publication  are  presented  in  the  latter  pert  of 
the  Brief.  Upon  completion  of  a major  phase  of  the  task,  formal  recommen- 
dations for  official  action  normally  are  conveyed  to  appropriate  military 
agencies  by  briefing  or  Disposition  Form. 


FOREWORD 


r 


Ths  Personnel  and  Manpower  Technical  Area  of  the  Army  Research  In- 
stitute for  the  Behavioral  and  Social  Sciences  (ARI)  conducts  research 
to  provide  scientific  methods  of  identify Iny  individuals  with  good  lead- 
ership potential,  selecting  officers  for  commissioning,  and  evaluating 
officer  performance.  One  means  of  prediction  and  assessing  leadership 
potential  is  through  associate  evaluation^  (’■'/'at  ratings) , which  have 
long  been  used  at  the  U.S.  Military  ivr ■’ -‘ray  and  in  Officer  Candidate 
Schools.  In  1972,  the  office  r»f  the  Deputy  Chiaf  of  Staff  for  Person- 
nel asked  ARI  to  investigate  the  value  of  associate  evaluations  in  all 
officer  schools,  beginning  with  the  Ranger  course.  ARI  Research  Problem 
Review  76-8  presented  the  results  of  the  initial  program  at  the  Ranger 
school  during  FY  197 3 f this  report  describes  the  validation  of  those 
initial  Ranger  peer  ratings  by  comparing  them  with  special  evaluations 
of  the  same  men's  performance  in  FY  1976.  The  research  wsb  accomplished 
under  Army  Project  2Q762717A766,  in  response  to  requirements  of  the  Of- 
fice of  the  Deputy  Chief  of  Staff  for  Personnel.  Portions  of  this  paper 
were  presented  at  the  17th  annual  conference  of  the  Military  Testing 
Association,  17-19  September  1975. 

The  associate  evaluation  program  has  become  operational  at  other 
officer  traininq  schools.  Associate  evaluation  techniques  are  still 
valuable  for  feedback  and  evaluation  in  officor  acquisition  and  train- 
ing programs,  including  KOTC,  and  are  valuable  predictors  of  officer 

success. 


VALIDITY  OF  PEER  RATINGS  OBTAINED  DURING  RANGER  TRAINING 


I 


.1 


BRIEF 


Purpose i , 

•f 

■J 

To  establish  the  validity  of  associate  ratings  obtained  in  selected  j-j 

olasses  of  the  Ranger  course  in  predicting  subsequent  performance  in  of- 
ficer  duty  Assignments.  jj 


Procedural 

Associate  ratings  and  other  measures  of  performance  in  the  Ranger 
course  had  bean  obtained  on  470  officers  attending  the  first  three  Ranger 
classes  in  FY  1973,  in  FY  1976  special-purpose  performance  evaluations 
were  obtained  for  313  of  the  470  officers  and  the  two  sets  of  evaluations 
compared . 


Findings  < 

Associate  ratings  obtained  during  Ranger  training  were  found  to  be 
predictive  of  all  attributes  measured  by  the  performance  evaluation 
form.  The  highest  degree  of  predictive  validity  was  obtained  for  rat- 
ings on  the  ability  defined  as  "making  decisions  and  initiating  action 
under  pressure."  Platoon  associate  ratings  during  training  were  better 
predictors  of  ratings  of  performance  or  of  potential  performance  than 
squad  peer  evaluations.  Both  tactical  officers'  evaluations  and  total 
Ranger  course  grades  were  found  to  be  significantly  related  to  several 
scales  of  the  performance  evaluation,  but  to  a lessor  degree  than  either 
form  of  peer  evaluation. 


Utilisation  of  Findings! 

Associate  ratings  appear  to  have  substantial  value  in  predicting 
subsequent  duty  performance  of  officers  who  attended  the  Ranger  course. 
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VALIDITY  OF  FKEK  HAT  I NOS  OUTAINKD 
DURING  RANC.KH  TRAINING 


INTRODUCTION 

The  military  has  a long  history  of  using  associate  evaluations.  j 

Some  of  the  better  known  programs  include  the  aptitude  for  service 

ratings  at  the  U.S.  Military  Academy  (Haggerty,  1903)  Tobin  & Mucrum,  ! 

1467),  officer  Candidate  School  ratings  (Parrish  S Druckor , 19f>7)  , -j 

basic  training  ratings  (Gordon  A Modi and,  1965),  and  the  use  of  poor  j 

ratings  in  the  assessment  of  officers  at  the  senior  field  grade  level  J 

(Downey,  Med  land,  & Yates,  1976).  The  success  of  these  and  other  pro- 
grams  was  a major  factor  in  a 1972  decision  by  the  Office  of  the  Deputy 

Chief  of  Staff  for  Personnel  to  investigate  the  use  of  associate  rat-  1 

ingo  in  Army  Officer  training  courses.  The  Hanger  course  was  selected 

as  a pilot  model  for  this  appraisal  technique  becausu  of  the  course's  ! 

importance  for  the  Army  leader's  primary  rola  in  ground  combat  and  be- 
cause of  the  extensive  field  exercises  involved.  J 

Downey  (1976)  reported  the  results  of  an  earlier  phase  of  the  re- 
search that  focused  on  the  feasibility,  reliability,  and  acceptability 
of  associate  ratings  in  the  Ranger  course.  Generally,  the  results  in- 
dicated that,  in  this  context,  associate  evaluations  wore  feasible  in 
terms  of  administration  and  automated  scoring  and  were  reliable  across 
different  training  periods  and  different  groups  of  evaluators.  How- 
ever, even  though  Ranger  course  students  generally  expressed  the  opin- 
ion that  associate  evaluations  were  appropriate  and  valid  measures  of 
leadership,  thoy  wore  not  positive  about  the  use  of  those  evaluations 
in  an  Army  personnel  system. 


OHdHCTlVKS 

The  major  objective  of  this  research  was  to  establish  the  validity 
of  the  associate  ratings  obtained  by  Downey  in  the  Ranger  course  by 
showing  their  ability  to  predict  officer  performance  in  subsequent,  duty 
assignments.  To  meet  this  objective,  it  was  necessary  to  evaluate  the 
psychometric  properties  of  the  device  designed  to  measure  officers' 
duty  performance.  Another  objective  was  to  compare  the  relative  effec- 
tiveness of  associate  ratings  with  other  training  grades  in  predicting 
duty  performance . 


if  MMisf.  " o ' * ilimi 


METHOD 


Sample 

Peer  rating  evaluations  and  other  information  wore  collected  on 
470  officers  who  attended  three  different  Ranger  classes  during  KY  1973. 
In  FY  1976,  performance  ratings  forms  were  mailed  for  427  (91%)  of  these 
officers.  Usable  performance  evaluation  measures  were  returned  and  pro- 
cessed for  313  (73%)  of  those  mailed.  Thus,  performance  moasures  were 
obtained  on  67%  of  the  original  sample  of  470  officers. 


Data  Collection  Instruments 


Peer  Evaluations . The  peer  evaluations  had  boon  obtained  within 
the  traininq  platoon.  As  an  independent  requirement,  the  Ranqor  course 
student  evaluation  system  also  included  peer  evaluations,  but  within 
the  squad  sotting.  In  the  platoon  peer  evaluations,  each  member  was 
roquired  to  nominate  the  eight  highest  and  the  eight  lowest  members  of 
the  platoon  whom  ho  would  most  like  or  least  like  "to  serve  with  in 
combat  because  of  his  potential  for  effective  leadership."  Downey 
(1976)  describes  this  procedure  in  greater  detail.  The  peer  evalua- 
tions were  obtained  at  the  end  of  each  of  the  three  phases  of  Ranger 
trainingi  a garrison  phase  at  Port  Benning,  Ga. , a mountain  phase  in 
Georgia,  and  a jungle  phuse  at  Gglin  Air  Force  Base,  Fla.  A composite 
peer  evaluation  score  combining  all  three  peer  evaluations  was  also 
derived. 

Ranger  Training  Scores.  A variety  of  training  evaluation  ucores 
was  obtained  on  students  attending  the  Ranger  course t (a)  nine  dif- 
ferent traininq  grades,  including  threo  tactical  training  officers' 

(TAC)  evaluations)  (b)  three  squad-level  peer  evaluation)))  and  (c)  a 
final  course  grade.  These  scores  are  shown  in  Table  1. 

Performance  Evaluation  Form.  Previous  research  by  Holme,  Willemin, 
and  Grafton  (1971)  and  Holme,  Willemln,  and  Day  (1971)  yielded  eight 
broad  dimensions  of  loader ship  stylo.  Two  othor  dimensions  reflecting 
consideration  and  the  initiation  of  structure  wore  identified  by  Stog- 
dill  (1974)  and  Fleislvman  (1974).  Consequently,  the  criterion  instru- 
ment used  in  this  research,  the  Performance  Evaluation  Form,  was  de- 
signed to  yield  ratings  along  nine  broad  dimensions  identified  by  these 
research  efforts,  as  well  as  one  rating  that  reflected  overall 
performance. 

The  10  scales  of  the  Performance  Evaluation  Form  are  shown  in 
Tabic  2.  Part  I of  the  form  evaluates  the  officer's  overall  perfor- 
mance in  his  principal  duty  assignment.  Parts  II  and  III  rate  the  of- 
ficer's potential  performance  along  crucial  domains  of  leadership. 

Table  2 shows  the  different  dimensions,  the  scales  that  reflect  those 
dimensions,  and  the  research  source  of  these  dimensions,  as  well  as 


VO  Ml'ijii  i 'j  • . 0 t'.-UliV  Uj  Illih 1 


.ciu  r •' nil  •infill  i iliiiil) 


: iamni.ua  ik-ai 


aiLUOti 


■aui. 


jIWU 


the  abbreviated  titles  of  che  scales  used  in  this  report.  On  each 
scale,  the  rater  was  required  to  rank  order  the  seven  Beales  in  Part 
II  of  the  instrument,  In  terms  of  the  officer's  relative  potential  for 
future  assignment,  and  was  also  to  rate  the  officer  on  a 7-step  scale. 
Parts  I and  III  required  only  a rating. 


Table  1 

Training  Evaluation  Scores  for  Ranger  Students 


Training  grades: 


Land  navigation  score 
Physical  training  score 
Practical  work  exam 
Patrol  grades 

Tactical  training  officer's  evaluation, 
Tactical  training  officer's  evaluation, 
Tactical  training  officer's  evaluation, 
Spot  reports 
Special  observations 


Port  Bonning 
mountain  phase 
Florida  phase 


Squad  associate  evaluations: 


Fort  Banning 
Mountain  phase 
Florida  phaso 

Final  course  grade 


All  ratings  on  the  scales  of  tho  Performance  Evaluation  Form  were 
performed  on  a 7-stop  scale:  tho  7 steps  of  this  scale  are  defined  in 
Table  .1  and  are  adapted  from  previous  work  by  Willumin  (1965). 

Four  copies  of  this  criterion  instrument  wore  mailed  to  the  per- 
sonnel officers  responsible  for  the  officer's  records,  one  rating  was 
to  bo  accomplished  by  the  officer's  immediate  superior.  A second  rat- 
ing was  to  bo  accomplished  by  a superior  officer  other  titan  the  officer's 
immediate  superior  {but  not  necessarily  the?  indorsing  official)  who  was 
Judged  to  know  the  officer's  performance.  The  two  additional  ratings 
were  to  be  made*  by  two  close  associates  who  wore  Judged  to  know  the 
officer's  performance.  Tito  three  raters  other  than  the  immediate 
supervisor  were  designated  by  the  personnel  officer  after  talking  with 
the  officer's  immediate  supervisor. 
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Table  2 


Performance  Evaluation  Form  Scales,  Corresponding 
Factors,  and  Abbreviated  Scale  Titles 


Performance  Evaluation 

Form  scale 

Factor 

Abbreviated  title 
of  acale 

Part  I 

Duty  performance 

Duty  performance 

Part  XI 

Applying  tactifal  knowledge  and 
skills  in  support  of  combat 
operations  . 

Tactical  staff  skills* 

Tactical  knowledge 

Understanding  *h«  mission  and 
clearly  dofljjfing  personal 
roles  of  subordinates  in 
its  accomplishment 

Team  leadership* 

Defining  personal 
role* 

Making  decisions  and  initiating 
actions  under  pressure 

Command  of  men* 

Making  decisions 

Defining  functional  roles  and 
duties  in  the  process  of  de- 
veloping subordinates  to 
fill  assignments  for  long- 
term unit  effectiveness 

Initiation  of  structure**'0 

Defining  functional 
roles 

Planning  and  organizing  man- 
power and  materiel  to  meet 
situational  requirement* 

Executive  direction* 

Planning  and 
organization 

Motivating  troops  to  accomplish- 
ing the  mission  by  taking 
into  consideration  their 
well-being  and  morale 

Consideration1*'0 

Motivating  troops 

Applying  knowledge  of  logistics 
and  technical  matters  to 
solve  support  problems 

Technical  staff  skills* 

Technical  knowledge 

Part  lit 

Combat  leadership 

Combat  leadership® 

Combat  leadership 

1Vohn i ca 1-manager i a!  leadership 

Technical -managerial 
leadership® 

Technical-managerial 

leadership 

‘'helms , Willemtn,  and  diafton  (l')71). 
^Fleishman  (l.“/4). 

°St.oqdi  1 1 ( 1‘>M)  . 
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Table  3 


Officer  I’or fo finance  Scale® 


Scale  value 


Description 


7 OUTSTANDING 


6 SUPERIOR 


5 ABOVE  AVERAGE 


4 AVERAGE 


3 BELOW  AVERAGE 


2 MARGINAL 


1 UNSATT  SiFAOTORY 


Far  above  the  requirements  of  the  situation, 
suggesting  the  highest  kind  of  formal  recogni- 
tion through  meritorious  award,  or  docor.it ion . 

Markedly  Above  the  requirements  of  the  situa- 
tion, suggesting  formal  recognition  through  a 
special  (favorable)  efficiency  report,  or 
letter  of  commendation. 

Somewhat  above  the  requirements  of  the  situa- 
tion, suggesting  informal  recognition  through 
specific  favorable  comment  in  hia  regular  ef- 
ficiency report,  and  through  informal  appreci- 
ation or  commendation. 

Fully  up  to  the  requirements  of  the  situation, 
suggesting  general  appreciation  (perhaps  montly 
unexpresaod) . 

Somewhat  below  the  regulroments  of  the  situa- 
tion, though  suggesting  only  the  mi _1 k ±nri 
o _f  corjrectdyQ  action  through  informal  recom- 
mendation for  improvement,  or  through  change 
of  duty  assignment  within  the  organization. 

Markedly  ho low  the  requirements  of  the  situa- 
tion, suggesting  formal  corrective  action 
through  a special  (unfavorable)  efficiency 
report,  administrative  admonition,  letter  or 
reprimand,  summary  court,  or  transfer  out  of 
the  organization. 

Far  _bel.pw t lie  recjiii  romoiu  s ot  the  situation, 
suggesting  the  most  dr an tic  kind  of  formal 
correct  ive  act  ion  through  reclaim  if icat ion, 
demot  ion,  general  coin  t , or  hoarding  out.  of 
t ho  Army. 


^Adapted  from  Willemin  (l%ii). 


Packets  of  rating  forms  wore  disLi  United  for  4^7  of  the  officers 
who  hail  attended  the  Ranger  course.  Rating*  wore  obtained  from  the 
supervisors  of  312  officers.  Superior  off.icerB,  other  than  the  immedi- 
ate auporv Isors , completed  ratings  forms  on  307  officers.  Ratings  by 
at  least  one  associate  were  received  for  309  officers,  and  ratings  by 
two  associates  wore  received  for  304  officers.  A usable  set  of  ratings 
was  defined  as  one  that  had  at  least  two  ratings.  In  ail,  313  usable 
returns  were  received. 


Analysis 

The  reliability  estimates  for  the  two  scales  of  Part  ll  of  the 
Performance  Evaluation  Form  were  obtained  using  the  alpha  coefficient. 
(Cronbaoh,  .1951) , treating  each  ratur  as  an  item.  The  BXtent  to  which 
the  scales  differentially  reflected  different  types  of  leadership  styles 
was  evaluated  by  appraising  the  aero  correlations  among  the  ratings  on 
these  scales. 

The  validity  of  the  associate  ratings  and  of  the  separate  Ranger 
training  grades  in  predicting  duty  performance  was  evaluated  by  obtain- 
ing the  xoro  order  correlations  between  each  of  these  measures  and  the 
10  scales  of  the  Performance  Evaluation  Form.  Two  separate  issues  re- 
lating to  the  predictive  validities  of  the  associate  ratings  and  the 
Ranger  training  grades  were  addressed i (a)  comparison  of  the  ability 
of  each  of  these  measure*  to  predict  total  performance,  and  (b)  compari- 
son of  the  relationships  of  these  measures  with  each  of  the  other  Per- 
formance Evaluation  Perm  scales. 


RKRUhTH 

Table  4 shows  t he  sums  and  standard  deviations  for  the  ratings 
and  rankings  of  the  scales  of  the  Performance  Kvaluat  ion  Form,  along 
with  the  aipha  coefficient  reliability  estimates  and  the  numbers  of 
case*  on  which  these  statistics  were  derived.  The  reliability  esti- 
mates for  the  ratings  ranged  from  ,(i0  for  duty  performance  to  .51  for 
motivating  troops.  Those  reliability  estimates  are  somewhat  lower  than 
those  reported  by  WUlemin  (19t>5),  who  reported  a reliability  estimate 
of  .73  for  four  raters  usiuq  the  same  technique.  The  somewhat  lower 
reliability  estimates  obtained  in  this  research  could  be  duo  to  the 
fact  that  this  sample  of  officers  wau  more  homogeneous  with  respect 
to  performance t as  Rangers,  they  were  a more  highly  select  group.  The 
reliability  estimates  for  the  ranking*  of  the  scales  ranged  from  .51) 
for  tactical  knowledge  and  skills  to  .10  for  defining  personal  roles. 

The  correl.rl  ions  among  the  sums  of  l he  ratings  and  the  sums  of 
the  rankings  are  shown  in  Table  *>.  The  correlations  among  the  ratings 
on  the  scales  exceeded  .70  with  only  tour  exceptions  (all  involving 
the  technical  knowledge  scale).  On  t hr'  other  hand,  I tie  cone  lat  ions 
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among  the  rankings  were  moderate  or  low  and  generally  negative  in  value. 
Use  of  the  ranking  technique  (ipsative  scores)  forced  this  negative  re- 
lationship, because  if  certain  scales  were  ranked  high,  others  had  to 
be  ranked  low. 

The  correlation  between  the  ratings  and  the  rankings  for  the  same 
type  of  scale  was  low  in  all  instances  except  one.  The  exception  was 
the  scale  that  reflected  ability  in  "making  decisions  and  initiating  i 
action  under  pressure,"  which  showed  a correlation  of  .53  between  the 
rating  and  ranking  techniques,  furthermore,  the  rankings  on  the  de- 
cision scale  were  more  hiqhly  correlated  with  ratings  on  the  othor 
scales  with  the  exception  of  the  scale  that  reflected  "technical 
knowledge . " 

The  results  indicated  that  both  the  ratings  on  each  scale  and, 
where  applicable,  the  rankings  of  the  scales  yielded  approximately  the 
same  reliability  estimates,  although  the  ratings  were  slightly  higher. 
The  high  intercorrelations  among  the  ratings  on  the  saales  indicated 
that  these  scales  yielded  little  differentiation  among  the  attributes 
being  measured.  On  the  other  hand,  results  of  analysing  the  ranking 
indicated  the  most  influential  dimension  in  evaluating  the  overall  duty 
performance  of  the  officer.  This  dimension  was  "making  dacisions  and 
initiating  action  under  pressure,"  which  yielded  a correlation  coeffi- 
cient of  ,43  between  rankings  on  this  scale  and  duty  performance.  Even 
though  the  rankings  of  the  scales  showed  some  degree  of  differentiation 
among  the  attributes  measured,  this  oould  be  due  to  the  forced  proper- 
ties of  the  ranking  method  rather  than  the  stimulus  material  that  con- 
stituted the  scalo  descriptions. 

Table  6 shows  the  zero  order  correlations  bstween  each  of  the 
Hanger  training  scores,  inaludlng  associate  ratings,  and  eaoh  of  the 
10  rating  scales  of  the  Performance  Evaluation  form.  For  the  Ranger 
training  scores,  three  types  of  evaluations— the  platoon  associate 
evaluations,  the  squad  peer  evaluations,  and  the  tactical  officer's 
evaluations—were  combined  across  the  three  training  phases  to  yield 
one  overall  score  for  each.  Ths  correlations  between  each  of  the 
Ranger  training  scores  and  each  of  the  seven  ranking  scales  of  the 
Performance  Evaluation  Form  are  shown  in  Table  7. 

The  results  shown  in  Table  6 indicate  that  the  platoon  associate 
ratings  and  the  squad  poor  evaluations  were  statistically  significant 
predictors  of  ratings  on  all  10  scales  of  the  Performance  Evaluation 
Form.  The  platoon  associate  evaluations  yielded  somewhat  higher  cor- 
relations with  the  criterion  measures  than  did  the  squad  peer  evalua- 
tions. This  could  bo  due  to  the  higher  reliability  of  the  platoon  as- 
sociate evaluations  (Downey,  1976) . Only  in  a few  instances  did  the 
othor  training  scores  obtained  in  the  Ranger  oourse  yield  statistically 
significant  correlations  with  the  ratings  of  current  performance  or  of 
potential  performance  in  future  assignments.  Of  particular  interest 
hore  wore  the  correlations  between  tho  criterion  instrument  scales  and 
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Table  6 


Intercorrelations  of  Performance  Evaluation  Form  Ratings 
and  Ranger  Training  Scores 
(n  - 295) 


Ranger 

Ratinge* 

training  scores 

1 

2 

3 

4 

5 6 

7 

8 0 10 

1.  Platoon  peer 


evaluations 

.20** 

.33** 

.24** 

.31** 

.20** 

.35** 

.28** 

.21** 

.3.1** 

,19** 

2. 

Land  navigation 
score 

-.03 

-.01 

-.04 

.00 

0 

1 

1 

o 

-.05 

tn 

o 

» 

.04 

-.02 

3. 

Physical  training 

.06 

.03 

.03 

.06 

.09 

.07 

.06 

.04 

.12* 

.03 

4. 

Practical  work 

exam 

-.10 

-.07 

40 

o 

f 

.02 

t 

© 

*sl 

.02 

-.06 

o 

t 

- . 09 

- . 06 

5. 

Patrol  grades 

.06 

.00 

.03 

.03 

.02 

.06 

.01 

.05 

.02 

-.01 

6. 

TAC-eveluations 

.01 

.07 

.05 

.12* 

.06 

.08 

.07 

.04 

.09 

.03 

7. 

Squad  pear 
evaluations 

.22* 

,22* 

.16** 

.24** 

.21** 

.26** 

.10** 

.15** 

.21** 

.11** 

8. 

Spot  reports 

.02 

.00  ' 

.03 

.00 

.03 

.04 

.03 

.05 

.06 

-.02 

9. 

Special  reports 

-.04 

.02 

-.02 

.05 

.01 

.03 

-.02 

-.01 

. 0.1 

.01 

10. 

Total  Rangar 
gradeb 

.01 

.15* 

.00 

.15* 

.08 

.15* 

.07 

.10 

.06 

.01 

‘*1  » Duty  performance  ratings 
2 ■ Combat  leadership  ratings 
J • Teoh.-manag.  leadership  ratings 

4 - Tactical  knowledge  ratings 

5 - Defining  personal  roloe  ratings 
(>  « Making  decisions  ratings 

) - Defining  functional  roles  ratings 
8 - Planning1 a organisation 
'»  ■ Motivating  troop  ratings 
10  ■ Technical  knowledge  ratings 

^Weighted  sum  of  all  training  grades. 

*P  • .05. 

**P  ■ .01 . lo 
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Table  7 


Xntercorrelations  of  Performance  Evaluation  Form  Rankings 
and  Ranger  Training  Scores 
(n  - 295) 


Ranklngaa 


Ranger  training  acoreu 

11 

12 

' 13 

14 

is 

16 

17 

1.  Platoon  peer 
evaluation 

.17** 

.03 

.34** 

-.20** 

-.16** 

.10 

-.25** 

2.  band  navigation 
score 

.04 

.17** 

-.01 

-.06 

-.03 

.09 

.09 

3.  Physical  training 

1 

o 

K3 

o 

• 

t 

.07 

-.04 

-.04 

.05 

-.02 

4.  Practical  work 

.00 

-.04 

.04 

(Tv 

O 

1 

.03 

-.06 

.09 

5.  vol  grades 

.07 

.00 

.09 

.00 

-.04 

-.06 

-.05 

6.  TAC-evaluations 

.13* 

1 

c 

.14** 

-.16** 

-.12* 

.00 

-.02 

7.  Squad  peer 
evaluations 

.13* 

.01 

.32** 

-.18** 

-.11 

.02 

-.18** 

8.  Spot  reports 

.12* 

-.13* 

.06 

-.12* 

-.02 

.04 

.01 

9.  Special  reports 

.12* 

.01 

.03 

-.09 

-.12- 

.02 

.01 

10.  Total  Ranger 
gradab 

.13* 

-.00 

.15** 

.07 

.07 

.03 

.11 

Ranking#  wore  reversed  bo  that  a hiqh  value  repreaentH  moat  effective. 
Scale  designations! 

11  » Tactical  knowledge  rankings 

12  - Defining  personal  roles  rankings 

13  - Making  decision  rankings 

14  - Defining  functional  rolea  rankings 

15  • Planning  a organisation  rankings 

16  • Motivating  troops  rankings 

17  - Technical  knowledge  rankings. 

^Weighted  sum  of  all  training  grades. 

*p  *.  . 05 . 

**P  N .01. 

li 


total  Ranger  grade.  The  correlations  between  the  total  Ranger  grade 
and  the  scales  reflecting  combat  leadership  potential,  tactical  knowl- 
edge, a~d  decisionmaking  were  all  significant  at  the  .05  level. 

The  correlations  shown  in  Table  7 between  tho  platoon  associate 
evaluations  and  the  ranking  of  five  of  the  Performance  Evaluation  Form 
scales  were  statistically  significant  but  negative  in  three  instances 
(i.e.,  defining  functional  roles,  planning  and  organisation,  and  tech- 
nical knowledge),  slightly  smaller  but  statistically  aignificant  cor- 
relations in  the  same  direction  were  obtained  between  the  squad  pear) 
evaluations  and  four  of  these  five  scales.  The  correlation  between  the 
squad  peer  evaluations  and  the  scale  on  technical  knowledge  was  not 
significant.  Evaluations  made  by  the  tactical  of floor  yielded  statis- 
tically significant  corrnkit  Jons  with  tho  ranking  on  four  of  the  scales. 
Further  examination  of  Table  7 reveals  other  statistically  significant 
relationships  between  certain  training  scores  and  tho  criterion  measures, 
The  negative  validity  coefficients  for  three  of  the  ranking  soalee  (de- 
fining functional  roles,  planning  and  organisation,  and  technical  knowl- 
edge) would  seem  to  be  a function  of  the  ipoative  nature  of  the  rankings. 
This  phenomenon  may  merely  mean  that  officers  not  poroeived  high  in 
decisionmaking  and  tactioal  knowledge  received  lower  rankings  in  these 
areas,  The  intercorrelations  of  ratings  would  seem  to  confirm  this 
idea. 


Again,  both  the  platoon  associate  evaluations  and  the  squad  peer 
evaluations  were  generally  the  beat  predictors  of  rankings  of  the  scales 
measuring  potential  performance.  The  platoon  associate  evaluations 
yielded  slightly  higher  correlations  with  the  criteria  than  did  the 
squad  evaluations. 

Table  8 shows  the  means  and  standard  deviation#  of  the  Ranger 
training  scores  for  the  officer  sample  uaed  in  this  research  and  the 
difference  between  the  mean  scores  of  this  sample  and  the  mean  scores 
of  the  original  sample  of  470  officers  who  attended  the  course.  The 
decrease  in  sample  size  was  due  to  the  fact  that  performance  ratings 
could  not  be  obtained  on  some  officers  because  they  had  loft  the  Army 
or  were  in  a transient  status)  in  some  instances,  the  Performance 
Evaluation  Forma  were  lost.  Table  8 reveals  that  only  minor  differ-  . 
ences  existed  bstween  the  two  samples  and  that  thsse  differences  do 
not  rspresent  any  systematic  bias  in  terms  of  training  grades. 


DISCUSSION 

The  reliability  estimates  of  each  off  tho  ratinq  scales  of  the 
Performance  Evaluation  Form,  an  well  as  tho  rankings  of  the  scales 
which  used  rankings,  were  considered  satisfactory  for  criteria.  How- 
over,  tho  distribution  of  ratings  on  tho  different  scales  showed  a 
tendency  toward  negative  skewness. 
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Table  8 


Ranger  Training  Score  Means  and  standard  Deviation#  for 
the  Validity  Sample , and  Difference  in  Mean 
Scorea  from  the  Entire  Training  Sample 


Difference  in 


Ranger  training  scores 

Muni! 

S.D. 

N 

means 

Platoon  evaluations— -Banning 

2.06 

.28 

307 

0 

Platoon  evaluations— -mountain 

2.0 

.28 

313 

0 

Platoon  evaluations— -Plorida 

2.02 

.33 

303 

-.1 

Land  navigation 

SI. 8 

10.4 

313 

1.1 

Physical  training 

26.9 

6.6 

313 

.9 

Practical  work  exam 

87.0 

4.1 

313 

1.0 

Patrol  grades 

358.2 

32.7 

305 

.2 

The  «valuation--Benning 

22.2 

3.3 

313 

.7 

TAC  evaluation— -mountain 

2S.B 

3.2 

313 

1.0 

TAC  evaluation-- ‘Florida 

27.0 

2.6 

305 

-.2 

Squad  evaluations— Banning 

37.7 

4.9 

312 

-.4 

SquAd  evaluations— mountain 

56,  P 

7.8 

312 

-1.0 

squad  evaluations— Florida 

55.4 

6.3 

303 

-.6 

Spot  reports 

-6.6 

21.7 

307 

-.4 

Special  reports 

-7.2 

5,6 

307 

-1.2 

Total  Ranger  performance 

724.6 

94.3 

310 

.2 

Note.  The  training  sample  was  made  up  of  individual!*  who  went  through 
Ranger  traininq  but  for  whom  validity  data  wore  not  collected 
later. 


A*  mentioned  previously,  the  ratings  on  the  different  scales 
were  highly  intercorrelated.  This  indicates  that,,  in  this  sample, 
the  instrument  did  not  reflect  the  expected  differentiation  among 
the  attributes  being  assessed.  Rankings  of  the  scales  tended  to  bet- 
ter differentiate  important  types  of  criterion  performance. 

In  terms  of  predictive  effectiveness  of  the  platoon  associate 
evaluations,  the  validity  of  these  evaluations  of  the  Rangers'  perfor- 
mance were  similar  for  all  scales  of  the  Performance  Evaluation  Form, 
with  the  lowest  correlation  being  obtained  between  platoon  associate 
evaluations  and  ability  to  apply  technical  knowledge.  Of  all  the  train- 
ing scores,  the  peer  evaluations  yielded  tho  highest  relationship  with 
all  of  the  ratings  on  the  10  scales  of  the  criterion  measure.  The  total 
Ranger  grade,  as  would  be  expected,  was  significantly  correlated 
(p  < .05)  with  the  scales  reflecting  combat  leadership,  tactical  knowl- 
edge, and  decisionmaking.  This  is  consistent  with  the  nature  and  pur- 
pose of  Rangsr  training. 

Tho  results  were  not  as  oloarcut  on  the  validity  of  peer  evalua- 
tions in  predicting  the  rankings  of  ths  seals*  that  reflect  potential 
performance.  Significant  positive  relationships  were  found  betwesn 
peer  evaluations  and  both  ths  tactical  knowledge  scale  and  the  decision- 
making seals.  Significant  nsgativs  relationships  were  discovered  be- 
tween peer  evaluations  and  ths  aoalss  that  measursd  ability  to  dafine 
functional  rolss,  planning  and  organisation,  and  technical  knowledge, 
given  the  "forced"  nature  of  these  rankings  and  the  assumption  that 
low  performers  were  generally  ranked  high  in  theee  areas. 

In  summary,  the  scales  of  the  criterion  instrument  were  found  to 
be  reliable.  A batter  degree  of  differentiation  among  the  attributes 
measured  was  obtained  by  rankings  than  was  obtained  by  ratings.  Associ- 
ate evaluations  obtained  during  Ranger  training  were  found  to  be  pre- 
dictive for  all  attributes  reflected  in  the  criterion  instrument,  with 
the  highest  predlative  index  obtained  for  ability  to  "make  decisions 
and  initiate  action  undor  pressure."  Platoon  associate  evaluations 
were  better  predictors  of  ratings  of  performance  or  potential  perfor- 
mance than  were  squad  peer  evaluations.  Both  the  tactical  officers' 
evaluations  and  the  total  Ranger  course  grades  showed  significant  but 
smaller  relationship!)  than  the  peer  evaluations  with  certain  scales  of 
the  criterion  ratings. 
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